Machine Vision Research Articles

A Reconfigurable Bipolar Image Sensor for High-Efficiency Dynamic Vision Recognition.

Dynamic vision perception and processing (DVPP) is in high demand by booming edge artificial intelligence. However, existing imaging systems suffer from low efficiency or low compatibility with advanced machine vision techniques. Here, we propose a reconfigurable bipolar image sensor (RBIS) for in-sensor DVPP based on a two-dimensional WSe2/GeSe heterostructure device. Owing to the gate-tunable and reversible built-in electric field, its photoresponse shows bipolarity as being positive or negative. High-efficiency DVPP incorporating front-end RBIS and back-end CNN is then demonstrated. It shows a high recognition accuracy of over 94.9% on the derived DVS128 data set and requires much fewer neural network parameters than that without RBIS. Moreover, we demonstrate an optimized device with a vertically stacked structure and a stable nonvolatile bipolarity, which enables more efficient DVPP hardware. Our work demonstrates the potential of fabricating DVPP devices with a simple structure, high efficiency, and outputs compatible with advanced algorithms.

Movement and binding control strategy based on a new type of rebar-binding robot

Purpose The paper focuses on the issue of manual rebar-binding tasks in the construction industry, which are marked by high labor intensity, high costs and inefficient operations. The rebar-binding robots that are currently available are not fully mature. Most of them can only bind one or two nodes in one position, which leads to significant time wastage in movement. Based on a new type of rebar-binding robot, this paper aims to propose a new movement and binding control that reduces manpower and enhances efficiency. Design/methodology/approach The robot is combined with photoelectric sensors, travel switches and other sensors. It is supposed to move accurately and run in a limited area on the rebar mesh through logical judgment, speed control and position control. Machine vision is used by the robot to locate the rebar nodes and then adjusts the binding-gun position to ensure that multiple rebar nodes are bound sequentially. Findings By moving on the rebar mesh with accuracy, the robot meets the positioning accuracy requirements of the binding module, with experimental testing accuracy within 5 mm. Furthermore, its ability to bind four rebar nodes in one place results in a high efficiency and a binding effect that meets building standards. Originality/value The innovative design of the robot can adapt itself to the rebar mesh, move accurately to the target position and bind four nodes at that position, which reduces the number of movements on the mesh. Repetitive and heavy rebar-binding tasks can be efficiently completed by the robot, which saves human resources, reduces worker labor intensity and reduces construction overhead. It provides a more feasible and practical solution for using robots to bind rebar nodes.

Automation inspection in metal fabrication: enhancing sheet metal forming processes with automation, machine vision, and image correlation for quality assurance

Automation inspection in metal fabrication: enhancing sheet metal forming processes with automation, machine vision, and image correlation for quality assurance

Light‐adaptive Mimicking Retina with In Situ Image Memorization via Resistive Switching Photomemristor Arrays

AbstractArtificial visual memory systems have been of particular interest since the development of machine vision and bionic robots. Ordinarily, the conventional system architecture requires the complex integration of two functional modules, a photo‐sensor and a memory device, which greatly limits the operating efficiency and increases the extra energy consumption. Nonetheless, other simply configured optoelectronics memory devices generally face challenges of adaption in complex light environments. Here, a resistive switching (RS) perovskite‐based photomemristor is presented that mimics the retina function. The dual function of light perception and in situ storage are both achieved. In the dark condition, it exhibits impressive memory performance with a high ON/OFF ratio of 104, a long retention time of over 104 s, and a low operating voltage of 0.38 V. With illumination, it shows self‐powered, broadband photo‐detecting characteristics with responsivity of 70 mA W−1 and detectivity of 7.5 × 1010 Jones. More importantly, benefiting from the material dual‐phase configuration, the highly steady photo‐adjusted RS windows are achieved. Its light‐adaptive memory application in dynamic environments is further demonstrated using the mimicking retina for a machine eye. This work can provide a strategy for enhanced RS photomemristor and its application in changing and varied scenarios.

Navigation line extraction algorithm for corn spraying robot based on YOLOv8s‐CornNet

AbstractThe continuous and close combination of artificial intelligence technology and agriculture promotes the rapid development of smart agriculture, among which the agricultural robot navigation line recognition algorithm based on deep learning has achieved great success in detection accuracy and detection speed. However, there are still many problems, such as the large size of the algorithm is difficult to deploy in hardware equipment, and the accuracy and speed of crop row detection in real farmland environment are low. To solve the above problems, this paper proposed a navigation line extraction algorithm for corn spraying robot based on YOLOv8s‐CornNet. First, the Convolution (Conv) module and C2f module of YOLOv8s network are replaced with Depthwise Convolution (DWConv) module and PP‐LCNet module respectively to reduce the parameters (Params) and giga floating‐point operations per second of the network, so as to achieve the purpose of network lightweight. Second, to reduce the precision loss caused by network lightweight, the spatial pyramid pooling fast module in the backbone network is changed to atrous spatial pyramid pooling faster module to improve the accuracy of network feature extraction. Meanwhile, normalization‐based attention module is introduced into the network to improve the network's attention to corn plants. Then the corn plant was located by using the midpoint of the corn plant detection box. Finally, the least square method is used to extract the corn crop row line, and the middle line of the corn crop row line is the navigation line of the corn spraying robot. From the experimental results, it can be seen that the navigation line extraction algorithm proposed in this paper ensures both the real‐time and accuracy of the navigation line extraction of the corn spraying robot, which contributes to the development of the visual navigation technology of agricultural robots.

HDR vision sensor with neuro-memristive skin detection for edge computing

Human skin classification is an essential task for several machine vision applications such as human-machine interfaces, people/object tracking, and classification. In this paper, we describe a hybrid CMOS/memristor vision sensor architecture embedding skin detection over a wide dynamic range. In-sensor RGB to rg-chromaticity color-space conversion is executed on-the-fly through a pixel-level automatic exposure time control. Each pixel of the array delivers two pre-filtered analog signals, the r and g values, suitable for being efficiently classified as skin or non-skin through an analog memristive neural network (NN), without the need for any further signal processing. Moreover, we study the NN performance and theorize how it should be added in the hardware. The skin classifier is organized in an array of column-level memristor-based NN to exploit the nano-scale device characteristics and non-volatile analog memory capabilities, making the proposed sensor architecture highly flexible, customizable for various use-case scenarios, and low-power. The output is a skin bitmap that is robust against variations of the illuminant color and intensity.

Accurate and rapid quantification of tea saponins using a thin-layer chromatography (TLC) method based on hemolysis and machine vision

Tea saponins are increasingly used in the food industries due to their biological activities. Current methods for the quantification of tea saponins are either inaccurate or time consuming and costly. In this study, a quantitative thin-layer chromatographic (TLC) method using machine vision and based on the hemolytic activity (HA) of tea saponins was developed. The optimized method consisted of ethanol extraction, sample loading, separation, color development, and smartphone-machine vision quantification. The new HA-TLC method was compared with UV spectrophotometric and liquid chromatographic methods, and achieved higher precision (RSD% = 0.75%) and accuracy (96.4%-106.2% recovery), with a limit of detection of 0.285 μg and limit of quantification of 0.95 μg. The method enables simultaneous qualitative and quantitative determination of saponins from different parts of tea plant extracts with high specificity, yet rapid and inexpensive, with high throughput and low solvent consumption, providing new options for saponin analysis in the food industry.

Objective Video Quality Assessment Method for Object Recognition Tasks

In the field of video quality assessment for object recognition tasks, accurately predicting the impact of different quality factors on recognition algorithms remains a significant challenge. Our study introduces a novel evaluation framework designed to address this gap by focussing on machine vision rather than human perceptual quality metrics. We used advanced machine learning models and custom Video Quality Indicators to enhance the predictive accuracy of object recognition performance under various conditions. Our results indicate a model performance, achieving a mean square error (MSE) of 672.4 and a correlation coefficient of 0.77, which underscores the effectiveness of our approach in real-world scenarios. These findings highlight not only the robustness of our methodology but also its potential applicability in critical areas such as surveillance and telemedicine.

Measurability of quality characteristics identified in latent spaces of Generative AI Models

Deep Learning can learn complex properties from image datasets, which are difficult to model with traditional machine vision algorithms, inherently in the form of disentangled latent spaces. With latent spaces of Generative AI models, a feature extraction method to access these properties can be implemented. This work evaluates whether the learned properties can be measured in the latent space. Quantity and quantity-value scale properties and the measurability of the dimensional quality characteristic ‘filling degree’ using a linear calibration function are demonstrated for an industrial machine vision application. An uncertainty indicator between 0.4–0.9 mm is estimated for the latent space measurements.

Self-powered photodetector based on 1D TiO2-3D CdS mixed dimensional heterostructure fabricated at low temperature

Solution processed photodetectors have garnered great attention in applications such as, machine vision perception, neuromorphic computing and opto-electronic memory storage. Though, such photodetectors offer several advantages such as ease of fabrication, high scalability, low thermal budget and low-cost processing, multi-modal functionality etc. however, they suffer from the major drawback of inferior device performance −as low responsivity and slow rise time, particularly due to the intrinsic poor crystallinity of the photoactive material. In this work, we demonstrate a solution processed photodetector with impressive performance at comparatively low processing temperatures (<150 °C) based on the mixed dimensional heterostructure configuration of 1D TiO2 nanorods and 3D CdS nanoflowers. TiO2 nanorods have been synthesized by hydrothermal technique, whereas their CdS sensitization is done by chemical bath deposition. Low cost carbon paste is used as electrode instead of conventional non-economic noble metal electrodes. X-ray diffraction studies validated excellent crystallinity of the photoactive material even under low temperature processing condition. The type-II Heterojunction (TiO2 and CdS) configuration photodetector shows efficient response at zero bias, thus yielding a self-powered device. The detector shows response in UV and visible region, with excellent responsivity of 110 mA/W (5 V), 563 µA/W (0 V) and a quicker rise time of 81 ms. Albeit the simple fabrication scheme and low processing temperatures, the detector exhibited promising figures-of-merit, which aids in fabrication of novel solution processed photodetectors.

A Machine Vision Approach with Temporal Fusion Strategy for Concrete Vibration Quality Monitoring

In concrete construction, ensuring the quality of vibration is paramount for maintaining the strength, durability, and quality of structures. This study proposed a method for monitoring the vibration quality of vibrating robots to replace subjective human judgment. The method employed an improved EfficientNetV2 model to classify the vibration quality into four levels: unqualified, middle, qualified, and over-vibration. A temporal fusion strategy was introduced, employing time-domain probability fusion to enhance the accuracy and stability of the results. Additionally, image patching was applied to reduce computational complexity while preserving feature integrity. Experimental results demonstrate that the proposed method outperforms common mainstream models, achieving an accuracy of 96.47%, with a relatively small parameter size of 13.8M. Compared to non-temporal fusion strategy, the accuracy is improved by 2.06%. This research has been successfully applied in practical engineering, providing a reliable means of quality assurance for concrete structures and demonstrating potential application prospects in the field of engineering construction.

Preparation and properties of micro-arc oxidation ceramic coatings using machine vision technology

Preparation and properties of micro-arc oxidation ceramic coatings using machine vision technology

An artificial visual neuron with multiplexed rate and time-to-first-spike coding.

Human visual neurons rely on event-driven, energy-efficient spikes for communication, while silicon image sensors do not. The energy-budget mismatch between biological systems and machine vision technology has inspired the development of artificial visual neurons for use in spiking neural network (SNN). However, the lack of multiplexed data coding schemes reduces the ability of artificial visual neurons in SNN to emulate the visual perception ability of biological systems. Here, we present an artificial visual spiking neuron that enables rate and temporal fusion (RTF) coding of external visual information. The artificial neuron can code visual information at different spiking frequencies (rate coding) and enables precise and energy-efficient time-to-first-spike (TTFS) coding. This multiplexed sensory coding scheme could improve the computing capability and efficacy of artificial visual neurons. A hardware-based SNN with the RTF coding scheme exhibits good consistency with real-world ground truth data and achieves highly accurate steering and speed predictions for self-driving vehicles in complex conditions. The multiplexed RTF coding scheme demonstrates the feasibility of developing highly efficient spike-based neuromorphic hardware.

Tool wear monitoring based on scSE-ResNet-50-TSCNN model integrating machine vision and force signals

Abstract In the realm of mechanical machining, tool wear is an unavoidable phenomenon. Monitoring the condition of tool wear is crucial for enhancing machining quality and advancing automation in the manufacturing process. This paper investigates an innovative approach to tool wear monitoring that integrates machine vision with force signal analysis. It relies on a deep residual two-stream convolutional model optimized with the scSE(Concurrent Spatial and Channel Squeeze and Excitation) attention mechanism (scSE-ResNet-50-TSCNN). The force signals are converted into the corresponding wavelet scale images following wavelet threshold denoising and Continuous Wavelet Transform (CWT). Concurrently, the images undergo processing using Contrast Limited Adaptive Histogram Equalization (CLAHE) and the Structural Similarity Index Method (SSIM), allowing for the selection of the most suitable image inputs. The processed data are subsequently input into the developed scSE-ResNet-50-TSCNN model for precise identification of the tool wear state. To validate the model, the paper employed X850 carbon fibre reinforced polymer (CFRP) and Ti-6Al-4V titanium alloy as laminated experimental materials, conducting a series of tool wear tests while collecting pertinent machining data. The experimental results underscore the model's effectiveness, achieving an impressive recognition accuracy of 93.86%. When compared with alternative models, the proposed approach surpasses them in performance on the identical dataset, showcasing its efficient monitoring capabilities in contrast to single-stream networks or unoptimized networks. Consequently, it excels in monitoring tool wear status and promots crucial technical support for enhancing machining quality control and advancing the field of intelligent manufacturing.

Rapeseed Seed Coat Color Classification Based on the Visibility Graph Algorithm and Hyperspectral Technique

Information technology and statistical modeling have made significant contributions to smart agriculture. Machine vision and hyperspectral technologies, with their non-destructive and real-time capabilities, have been extensively utilized in the non-destructive diagnosis and quality monitoring of crops and seeds, becoming essential tools in traditional agriculture. This work applies these techniques to address the color classification of rapeseed, which is of great significance in the field of rapeseed growth diagnosis research. To bridge the gap between machine vision and hyperspectral technology, a framework is developed that includes seed color calibration, spectral feature extraction and fusion, and the recognition modeling of three seed colors using four machine learning methods. Three categories of rapeseed coat colors are calibrated based on visual perception and vector-square distance methods. A fast-weighted visibility graph method is employed to map the spectral reflectance sequences to complex networks, and five global network attributes are extracted to fuse the full-band reflectance as model input. The experimental results demonstrate that the classification recognition rate of the fused feature reaches 0.943 under the XGBoost model, confirming the effectiveness of the network features as a complement to the spectral reflectance. The high recognition accuracy and simple operation process of the framework support the further application of hyperspectral technology to analyze the quality of rapeseed.

AGRICULTURAL FIELD MANAGEMENT PROBLEMS: FROM CLASSIC AGRO-TECHNOLOGIES TO ARTIFICIAL INTELLIGENCE

The text is straightforward and precise. The agricultural sector has been significantly impacted by artificial intelligence (AI) technologies such as expert systems, natural language processing, speech recognition, and machine vision. This is due to factors such as the rising global population, increasing demand for food, changing weather conditions, and water availability. AI has not only increased the quantity of work in agriculture but also improved its quality. Researchers and scientists are now adopting new IoT technologies in smart farming to enable farmers to use AI technology for the advancement of seeds, crop protection, and fertilizers. This would enhance the financial viability of farmers and contribute to the general economic growth of the nation. AI is being used in three primary areas in agriculture: soil and crop monitoring, predictive analytics, and agricultural robots. Farmers are increasingly using sensors and soil sampling to collect data for farm management systems, which will be utilized for future studies and analysis. This paper enhances the area by doing a study of artificial intelligence applications in the agriculture industry. The text provides an introduction to AI, covering several AI techniques used in the agricultural sector, such as machine learning, the Internet of Things (IoT), expert systems, image processing, and computer vision.

A comprehensive research on measurement and evaluation of intelligent meter reading systems

Abstract Based on the machine vision and artificial intelligence technologies, the reading and acquisition of meter values have become the mainstream technical solutions for real-time monitoring of production data in the current industrial field. At the same time, the number of intelligent instruments and meters is increasing, and the quality varies. There is a lack of scientifically measurement methods and quality trust for intelligent meter reading algorithms. To promote their reliable and widespread application in various fields, it is necessary to conduct in-depth research on the assessment system of artificial intelligence in intelligent meter reading systems. This paper comprehensively studies various aspects involved in the emerging measurement field of artificial intelligence evaluation at the current stage, providing scientific measurement and evaluation references for the quality trust of artificial intelligence in the field of meters.&amp;#xD;

Modern techniques in detecting, identifying and classifying fruits according to the developed machine learning algorithm

Recent developments in machine vision have opened up a wide range of applications, and farming is no exception. Deep learning (DL) has a wide range of applications because of its capacity to extract robust features from photos. Shape, color, and feel of many fruit species make it difficult to discover and classify fruits. When examining the effects of artificial intelligence on fruit identification and classification, we noted that, up until 2018, the majority of approaches relied on traditional machine learning (ML) techniques, while just a few ways took use of DL techniques for recognizing fruits and categorization. In this post, we thoroughly covered the datasets that many academics utilized, the useful descriptors, the application of model, and the difficulties of utilizing DL to identify and classify fruits. Finally, we compiled the outcomes of various DL techniques used in earlier research to identify and categorize fruits. This work examines the use of models based on DL for fruit categorization and recognition in recent studies. In order to make it simpler for beginning agricultural researchers to comprehend the importance of ML in the agricultural domain, we have developed a DL model for apple categorization using the well-known dataset "Fruit 360" starting scratch.

Application of Machine Vision Based on the Second Law of Thermodynamics in High-Temperature Industrial Inspection

Application of Machine Vision Based on the Second Law of Thermodynamics in High-Temperature Industrial Inspection

Fine-Grained Detection Model Based on Attention Mechanism and Multi-Scale Feature Fusion for Cocoon Sorting

Sorting unreelable inferior cocoons during the reeling process is essential for obtaining high-quality silk products. At present, silk reeling enterprises mainly rely on manual sorting, which is inefficient and labor-intensive. Automated sorting based on machine vision and sorting robots is a promising alternative. However, the accuracy and computational complexity of object detection are challenges for the practical application of automatic sorting, especially for small stains of inferior cocoons in images of densely distributed cocoons. To deal with this problem, an efficient fine-grained object detection network based on attention mechanism and multi-scale feature fusion, called AMMF-Net, is proposed for inferior silkworm cocoon recognition. In this model, fine-grained object features are key considerations to improve the detection accuracy. To efficiently extract fine-grained features of silkworm cocoon images, we designed an efficient hybrid feature extraction network (HFE-Net) that combines depth-wise separable convolution and Transformer as the backbone. It captures local and global information to extract fine-grained features of inferior silkworm cocoon images, improving the representation ability of the network. An efficient multi-scale feature fusion module (EMFF) is proposed as the neck of the object detection structure. It improves the typical down-sampling method of multi-scale feature fusion to avoid the loss of key information and achieve better performance. Our method is trained and evaluated on a dataset collected from multiple inferior cocoons. Extensive experiments validated the effectiveness and generalization performance of the HFE-Net network and the EMFF module, and the proposed AMMF-Net achieved the best detection results compared to other popular deep neural networks.